ai/com.siddharth.kmp.ai/[android]MediaPipeOnDeviceLlm

MediaPipeOnDeviceLlm

class MediaPipeOnDeviceLlm(context: Context, modelManager: MediaPipeModelManager, config: GenerationConfig? = null) : OnDeviceLlm

Constructors

constructor(context: Context, modelManager: MediaPipeModelManager, config: GenerationConfig? = null)

Properties

supportsImage

open val supportsImage: Boolean

True when this backend accepts an LlmPart.Image in generate. False = text-only.

Functions

generate

open suspend override fun generate(prompt: String): String?

Runs prompt on-device. Returns the model's text, or null when unavailable/declined/failed.

open suspend fun generate(parts: List<LlmPart>): String?

Multimodal entry point. Default maps a single LlmPart.Text onto generate (String) so every existing text-only actual (MediaPipe, Foundation Models, jvm) keeps working with zero changes. Backends that accept images (ML Kit GenAI) override this directly.

generateStream

open fun generateStream(prompt: String): Flow<String>

Streaming variant of generate. Default replays the single-shot result as one emission so every existing actual keeps working with zero changes; backends with native token streaming (ML Kit GenAI) override this directly.

open fun generateStream(parts: List<LlmPart>): Flow<String>

isAvailable

open override fun isAvailable(): Boolean

Cheap, synchronous floor — true only when the platform could run inference. NOT the authoritative runtime check (model residency is async); generate still guards internally.